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ABSTRACT 

In  testing  hypotheses  involving  order  restrictions  on  a 
collection  of  parameters,  distributions  arise  which  are  mix¬ 
tures  of  standard  distributions.  Since  tractable  expressions 
for  the  mixing  proportions  do  not,  in  general,  exist  even  for 
parameter  collections  of  moderate  size,  the  implementation  of 
these  tests  may  be  difficult.  It  is  not  necessary  to  bound 
the  individual  mixing  proportions  in  order  to  obtain  a  bound 
for  the  tail  probabilities  of  the  "mixed"  distributions. 
Bounds  for  such  tail  probabilities  are  derived  and  their 
application  to  several  order  restricted  hypothesis  testing 
situations  is  discussed.  These  results  are  also  applied  to 
obtain  the  least  favorable  configuration  in  a  two  sample 
likelihood  ratio  test  of  the  equality  of  two  multinomial 
populations  versus  a  stochastic  ordering  alternative. 
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1.  INTRODUCTION.  Distributions  having  tail  probabilities, 
which  are  weighted  averages  of  the  tail  probabilities  of 
standard  distributions,  play  an  intrinsic  role  in  order 
restricted  hypothesis  tests  (cf.  Barlow  et  al.  (1972),  parti¬ 
cularly  Chapter  3).  Use  of  these  test  procedures  can  be 
cumbersome  since  no  tractable  expressions  exist,  in  general, 
for  the  weights  associated  with  the  various  standard  tail 
probabilities.  In  order  to  be  more  specific,  consider  the 


following  example.  Suppose  ,5^  , .  .  .  ,5^  are  the  means  of 

independent  random  samples  from  normal  distributions  with 

2  2  2 

means  ,y  2  , . .  .  ,uk  and  variances  CTi»a2»  •  •  •  ,°]c*  respectively. 
If  the  variances  are  known, then  a  likelihood  ratio  statistic 


for  testing  HQ:  p1  =  P2  = - =  Pk  vs.  ^  ^  1  •••  £ 

is 


T01  =  -I  in  1  =  E.=1“i(5ki  -  v) 

2 

where  A  is  the  likelihood  ratio,  w.  =  n./o.,  n.  is  the  size  of 

k  k  1  It 

the  ith  sample,  p  =  l  w^./J  wi  and  >^2 » ’  ‘  *  »**kk  are 

i= 1  i=l 

the  maximum  likelihood  estimators  of  p^,p2,...,pk  subject  to 
the  restriction  imposed  by  H^.  (Computation  of  the  Pk^  is 
discussed  at  length  in  Barlow  et  al.  (1972).)  Bartholomew  (1959) 


studied  TQ1  and  proved  that 

k  ? 

(1)  P[T01  >  c]  =  l  PU,k)  Pfxc_x  1 

2 

whenever  HQ  is  satisfied.  The  symbol,  xv>  will  he  used  to 

2 

denote  a  chi-squared  variable  with  v  degrees  freedom  (xq =  0) 
and  P(£,k)  denotes  the  probability,  under  Hq,  that  there  are 
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exactly  L  distinct  values  (levels)  among  *  *^Jc)c * 

The  distribution  given  in  (1)  is  called  a  chi-bar-squared 
distribution. 

A  detailed  discussion  of  the  P(£,k)s  may  be  found  in 
Barlow  et  al.  (1972).  (All  references  in  this  and  the  next  two 


paragraphs  refer  to  that  source.)  Use  of  TQ1,  as  a  test 
statistics,  is  cumbersome,  for  unequal  weights  and  for  k  ^  5, 
since  no  tractable  general  expression  for  P(£,k)  has  been 
found.  Explicit  formulas  for  k  <_  4  are  given  on  pages  140 
and  141.  If  the  weights  are  all  equal,  the  P(£,k)  can  be 
found  recursively  from  Corollary  B  on  page  145  and  their 
values  in  this  important  special  case  are  tabled  in  Appendix 
A. 5  for  k  <  12.  In  theory,  the  recursion  formula,  (3.23),  on 
page  139  gives  a  general  tool  for  computing  the  P(£,k)s. 

However,  its  implementation  is  virtually  impossible  since  it 
requires  computation  of  P(j,j)  and  for  j  >  5  no  closed  form 
expression  for  P(j,j)  exists.  (By  interpolating  in  the  table 
given  in  Abrahamson  (1964),  one  can  obtain  P(5,5).)  Of  course, 
for  fixed  k  and  specific  weights  one  could  Monte  Carlo  the  P(£,k). 

It  has  been  suggested  that  the  P(£,k)s  are  fairly  robust  to 
the  weights  (cf.  Grove  (1980))  and  that  the  values  for  equal  weights 
give  reasonable  approximations  except  in  unusual  cases.  However, 
the  nature  of  this  robustness  does  not  seem  to  have  been  quantified 
and  no  insight  into  the  nature  of  those  rare  cases  has  been  given. 
Insight  into  both  of  these  claims  is  given  by  the  analysis  in 
Section  2. 

The  bound  P(k,k)  <  (l/2)k_1  is  given  on  page  138.  Similar 
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bounds  for  P(£,k);f  =  1,2,..., k-l  can  be  obtained  as  follows. 

For  arbitrary  positive  weights,  using  the  minimum  lower  sets 

algorithm  for  * '  *  »^kk*  we  have 

a  k 


][  w.X.  £  w.X. 

(2)  P(l.k)  =  PCmin  z  <  a  <  k  -*=| - -  s 


] 


l 

5*1 

k-l  k 

I  w,R.  J  w.X, 


w . 
3 


I  wa 
j=i  3 


3  3 


>  -J 


5  =  1  3  3 


5*1 


w . 
3 


-  k 

I 

5*i 


]  =  1/2. 
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These  bounds  for  P(j,j)  and  P(l,j)  can  be  used  in  the  recursion 
formula,  (3.23),  to  derive  the  following: 

(3)  PU,k)  <  ^  1  1  <  l  <  k-l. 

This  bound  seems  fairly  reasonable  for  values  of  l  close  to  k 

but  not  so  sharp  for  smaller  values  of  l.  For  example,  it  yields 

k-l 

P(k-l,k)  (k-l)/2  which  seems  as  sharp  as  the  bound  for  P(k,k). 

On  the  other  hand,  for  k  =  5  it  yields  8/16,  12/16,  9/16,  as 

bounds  for  P(l,5),  P(2,5),  and  P(3,5)  respectively. 

As  we  shall  see  in  Section  2,  we  do  not  need  to  bound  the 

individual  P(£,k)s  in  order  to  get  a  bound  for  (1).  Specifically, 

in  order  to  obtain  an  upper  bound  for  (1)  it  sufficies  to  find 

k  k 

numbers  b, ,b„,...,b,  such  that  T  b»  >  \  P(£,k)  for 

12  *  t* a  C  ~  l*a 

a  =  l,2,...,k.  Bounds  of  this  form  are  given  in  Theorem  1  and 

Remarks  2  and  3  show  that  these  bounds  cannot  be  improved,  in 

general.  In  Section  Three  application  of  these  bounds  to  several 

order  restricted  testing  problems  is  discussed.  One  application 


-  n^Ma 
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considered  is  to  a  likelihood  ratio  test  of  the  equality  of 
two  multinomial  populations  against  a  stochastic  ordering 
alternative.  Here, the  bounds  give  a  least  favorable  con¬ 
figuration  within  the  non-simple  null  hypothesis  and  can  be 
used  to  describe  conservative  rejection  regions  for  this 
test.  Details  of  this  problem  are  described  in  another  paper. 

The  theory  in  Section  2  gives  one  a  feel  for  the  sensi¬ 
tivity  of  the  P(£,k)  to  the  weight,  as  well  as  the  circumstances 
under  which  one  could  either  use  the  bounds  or  the  expressions 
for  the  equal  weights  case  as  approximations. 

2.  TAIL  PROBABILITY  BOUNDS.  The  vector  y^  =  (y^ >^2 *  *  *  *  ’^kk^ 

is  referred  to  as  the  isotonic  regression  of  the  vector 

X  =  (SlfS2.....V  with  weights  w^,w^ , .  .  .  ,w^.  The  computation 

algorithms  referred  to  in  this  section  are  described  in  detail 

in  Barlow  et  al.  (1972).  A  basic  idea  in  this  section  is  that 
2  2 

since  P[Xy  >_  c]  <  ptXv+1  >  c]  for  v  =  0,1,2,...  and  for  all  c, 
one  obtains  an  upper  (lower)  bound  for  (1)  by  making  the 
distribution  of  the  number  of  level  sets  in  y^  as  large  (small) 
as  possible. 

Theorem  1 .  Assume  that  y ^  =  y ^  ~  • • •  =  4^  =  y •  If 

al  5  a2  -  • • ■  i  ak,then 

k  k 

(4)  (a,+a,)/2  <  I  P(f,k)a»  <  \  (»'?-)2'k  +  1  a. 

X  i  -t  t-i  c 

for  k  =  2,3,...  .  If  >  aj  >  . . .  >  a^,  then  the  inequalities 
in  (4)  are  reversed. 

Proof :  The  second  conclusion  follows  from  the  first  by  noting 


A 


7 


that,  in  this  case,  -a^  <  -a2  £  . . .  £  -a^.  or<3er  to 

establish  the  first  conclusion,  observe  that  if 
3  3  k  k 

l  bf  I  I  b«  for  j  =  1,2,... ,k-l  and  [  b,  =  7  b* 

■d=l  4  l-l  4  £  =  1  4  t=l  4 

then,  setting  a^+1  =  0,  we  can,  by  Abel's  method  of  summation, 

write 

k  k  f  k  l 

^e=i  a*b*  =  ^=i  (a*'a*+l)  ^j=1  bj  -  ^=1  <afa£+i)  ^j=1  b! 

k 

=  l  a  »b*  . 

£  =  1  4  4 

Thus,  since  P(£,k);  £  =  1,2,. ..,k,  (^~^)2~k+1;  l  =  1,2,. . .  ,k 
and  1/2,  1/2,  0,  ...,  0  are  probability  distributions  on  {1,2,.. 
it  suffices  to  show  that  P(l,k)  <  1/2  and 


(5)  I3  d"h2-k+1  <  E3  PU,k);  j  =  1 , 2  , .  . .  ,k-l. 
*=1  4-1  ”  £=1 


The  first  inequality  has  already  been  established.  (See  (2).) 

In  order  to  establish  (5)  we  use  induction  on  k  and  the  pool 
adjacent  violators  algorithm  (PAVA)  for  y^..  For  the  case  k  =  2 
it  is  easy  to  see  that  P(l,2)  =  P(2,2)  =  1/2  independent  of  the 
values  of  w^  and  w^.  Assume  (5)  holds  for  k  and  let 

w1,w2, . .  .  ,wk>  denote  the  number  of  level  sets 
in  the  isotonic  regression  of  R 2 , . . .  ,Xk  with  weights 

Wi,w2,...,wk.  Now,  by  the  PAVA,  the  isotonic  regression,  yk+^, 
of  ^1*^2’  *  *  *  weights  w^ ,Wj » . • • »wk+^  may  be  formed  by 

first  constructing  y^,  the  isotonic  regression  of  ’ *  * ' *^k 

with  weights  w^ ,W2 , . . . ,w^ ,  and  then  combining  y^  with  Xk+^  in 
the  appropriate  way.  Thus,  using  the  obvious  rotational  abuses, 
either  Lk+^  =  +  1  or  Lk+^  and  the  former  case  is 


>k} 
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characterized  by  Skk  <  Xk+1-  Thus,  Lk+1  <  LR  + 
and  for  3  =  1,2,. . . ,k, 

(6)  PCLktl  >  <  P[Lk  *  i[Sk+i >  ;k3  1  jnl 

=  P[Lk  =  j  and  Xk+1  >  Skk3  +  P[Lk  »  j+13 . 

Using  the  notation  in  Barlow  et  al.  (1972)  and  using  the  proof 
of  their  (3.23),  we  can  express  P[Lk  =  j  and  Xk+1  >  UkJ<J  as  a 
sum  of  the  form 

Y  P[Av(B,  )  <  Av(B-)  <  ...  <  Av(B.)  <  X.  ..  ]  ,l.P(l,C.  •,  w(B.)) 

“  j  -L  z  ]  K  +  _L  X  =  -L  1 

i-  »  T  X 

D 

Applying  their  inequality  (3.20)  to  the  first  factor  in  each 
term  yields  the  following  bound: 

y  PtAv(Bj)  <  Xk+^]P  (  j  ,  3  i  Wg  »Wg  , .  .  .  »^b  .  )i-l  *  w(B^)). 

Lj,k  12j  1 

Bounding  the  first  factor  in  each  term  by  1/2  and  again  using 

(3.23)  yields  P[LR  =  3  and  Xk+1  >  vkk]  <  P(j,k)/2.  Thus, 

applying  the  induction  hypothesis,  we  obtain 


P[Lk+l  -  3  +  U  1  (P( j  »k)  +  2  P[Lk  >  j  +  l])/2 
=  (P[Lk  >  j]  +  PCLk  >  j  +  1] ) / 2 

<  l"  ♦  I"  (^)2^ 

"  k;i  ^=3+i  1  1 

=  1“  1  ♦  *i>} 

= 2_k  ik+1  (^). 

£=j+l  L  1 

This  is  the  desired  result. 

It  is  conjectured  on  page  174  of  Barlow  et  al.  (1972) 


A 
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^  O 

that  \  P(£,k) (-l)c  =0.  In  view  of  this  conjecture  it  is 

1=1 

interesting  to  note  that  both  of  the  bounding  distributions, 

(1/2,  1/2,  0,  0,  ...,  0)  and  (*"*) (l/2)k"1;  l  =  1,2,. . . ,k, 

on  {l,2,...,k}  have  this  property. 

The  bounds  given  in  (4)  cannot,  in  general,  be  improved. 

Specifically,  there  exist  sequences  w^  =  >wn2 » •  ■  •  >wn]() 

and  w'  =  (w',w'0,...,w',)  with 
n  nl  n/  nk 


(7) 
and 

(8) 


lim  P(£,k;  w  ) 
n+eo  5  ’  n 

lim  „  PU,k;  w’) 
n-*-<»  n 


rk-l.0-k+l 

2'1! 

*  1[£=1,2] 


for  l  =  l,2,...,k.  We  first  consider  the  shifted  binomial 
distribution  in  (7).  If  we  let 


(9)  w(e)  = 


(e^,e^  ■*" , . . .  ,e ,  1  ,e , . . .  ,£^)  for  k  odd 


.  H-l  H-2  .  .  H-l v  .  , 

(e  ,e  , . . . ,e , 1 , 1 ,e , . . . ,e  )  for  k  even 


where  H  =  [k/23,  then  (7)  can  be  obtained  by  letting  e-»-0.  The 
proof,  however,  is  complicated  and  we  offer  a  less  involved 
proof  by  induction. 

Remark  2  Let  y^  =  y 2  =  •••  =  For  each  k  >_  2  and  for  each 

e  >  0  there  exist  positive  weights  w^ ,w^ , . . . ,w^  such  that 

|P(£,k;  wl5w2, . . . ,wR)  -  ( Jli ) (1/2 )K_1 |  <  e 


for  l  =  1,2, ... ,k. 

Proof :  Assume,  without  loss  of  generality,  that  the  common 
value  of  y^,y £,..., yk  is  zero.  As  before,  the  result  is  obvious 


A 
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for  k  =  2.  Assume  that  k  ^  3  and  that  e  >  0.  By  the  induction 
hypothesis,  there  exist  weights  w^Wj^.-jW^  ^  such  that 

|P(£,k-l)  -  (k"J)(l/2)k“2|  <  e/4;  l  =  1,2 , . . . ,k-l. 

Let  w'  =  (w1,w2,...,wv_1)  and  let  w  =  (w.,  ,w0 , .  .  .  ,wv)  where  w^ 


1’  2  : 


is  to  be  specified.  First  consider  P(k,k;  w) .  As  noted  in 

the  proof  of  (3),  P(k,k;  w)  <_  (l/2)k  \  Write  PCk,k;  w)  as  an 

iterated  integral  where  the  innermost  integral  is 
#00 

|  (2ttw^^)  exp{-x2/ (  2w^ )  }dx^ ,  which  can  be  bounded 

Xk-1 

below  by  (1/2)  -  |  x^_^  J  ( 27rw^'*')~'''^2  .  Letting  w^O  and  applying 
the  dominated  convergence  theorem,  we  obtain  a  lower  bound 
which  converges  to(l/2)P(k-l,k-l;  w')  as  w^+0 .  Thus,  using 
our  induction  hypothesis,  for  sufficiently  small  w^  we  have 

( 1/2 )k_1  >  P ( k , k ;  w)  >(1/2)  P(k-l,k-l;  w’  )  -  e/2  >  (l/2)k_1  -  e. 

Now  assume  l  <  k-1  and  write  P(£,k)  =  £  using  (3.23)  in 

Llk 

Barlow  et  al.  (1972).  (For  rotational  convenience  we  do  not 
show  the  individual  terms  being  summed).  Partition  the  sum 
in  (3.23)  into  terms  involving  B^  such  that  =  { k }  and 
otherwise.  Specifically,  we  write  P(£,k)  =  £  +  £  , 

i  »  i  » i 

Llk  Llk 

where  L ^  contains  those  elements  in  with  B^  =  {k}  and 

L^y  =  I.£ ^  -  L^.  We  consider  £  first.  The  only  factors, 

Llk 

in  the  general  term,  which  involve  w^  are  P(l,l;  w^)  =  1  and 
P(Av(B1)  <  Av(B2)  <  ...  <  Av(B^)).  The  argument  given  above 
for  P(k,k;  w)  applied  to  the  first  factor  in  each  term  of 


11 


l 


shows  that  lim  .n  I  =  (l/2)P(£-l,k-l;  w'). 
Lo\_  V0  L* 


•£k  ~  ^k 

In  considering  lim  n  J  ,  we  first 

k  U  L  •  ' 


note  that 


' Ik 


P(Av(B1)  <  Av(B2)  <  ...  <  Av(B£) )  ->  P(Av(B1)  <  Av(B2)  <  ...  <  Av(B^-{k} )  )  . 


If  j  is  the  smallest  element  of  B^  and  if  A  denotes  the  event 
[min j  <  a  <  k_1  Av ( { j , . . . , a } )  >  Av( { j , . . . ,k} ) ] ,  then 


P(1,C 


w(B£))  =  PCAOCXk  >  0])  +  P(AO[Xk  <  0]). 


Furthermore , 


P(AO[Xk  >  0])  <  P[Av( { j , . . . ,k-l} )  >  Av( { j , . . . ,k} ) ,  Xk  >  0] 

<_  P[Av(  { j  ,  .  .  .  ,k-l} )  Xk  >  0]  =  P[/w^  Av({  j  , .  .  .  ,k-l} )  >_  /w^  Xk 

but  this  probability  converges  to  zero  as  wk+0  since  /w^  Xk  has 
a  standard  normal  distribution  and  /w^  Av( { j , . . . ,k-l} )  ->  0.  The 
other  term,  P(AO[Xk  <  0]),  can  be  written  as  the  sum  of 


P(AO[Xk  <  0,  min^  <  Q  <  k_^  Av({j,...,a})  =  Av({j,...,k-l})]) 
and 

P(AO[Xk  <  0,  min^  <  a  <  Av  ( {  j  , .  .  .  ,a } )  <  Av(  {  j  ,  .  .  .  ,k-l} )  ]  ) . 

Since 


P(AcO[Xk  <  0,  min^  <  a  <  Av( ( j , • • • ,a} )  =  Av( ( j , • • • ,k-l} ) ] ) 

<  P [ A v ( { j , . . . , k } )  >  Av( { j , . . . ,k-l} ) ,  Xk  <  0] 

<_  P[/w^  Av({  j  , .  .  .  ,k-l} )  <_  Xk  <_  0]  -*•  0  as  wk  -*•  0, 
we  see  that 

P(AO[Xk  <  0,  min^  <  a  <  k_1  Av(  {j  ,...,<*} )  =  Av(  { j  , .  .  .  ,k-l}  )  ])  -*■ 
(1/2)  Ptmin^  <  a  <  Av( ( j , . • . ,a } )  =  Av( { j , . . . ,k-l) ) ]  = 

(1/2)  P(1,CB  _{k};w(B£  -  {k})). 


12 


Note  that  Av({  j  ,  .  .  .  ,a} )  for  ot  =  j,...,k-l  does  not  depend  on 

k  k 

wk  and  that  Av(B.)  =  £  w  X  /[  w  ->  Av( { j  ,  .  .  .  ,k-l} )  as 

v=j  v=j 

wk->-0  and  so  P(AO[Xk  <  0,  min^  <  a  <  k-1  Av  ( { j  ,  .  .  .  ,a } )  = 

Av  ({j,...,k-l})])  +  0  as  w  +0.  Hence,  lim„  £  =  (1/2 )  Ptt;k-1 ;  w 

k  Li'k 

Thus,  lim  n  P(£,k;  w)  =  (P(f-l,k-l;  w')  +  PU,k-l;  w'))/2.  By 
wk 

our  induction  hypothesis,  this  limit  is  sufficiently  close  to 

(f-2 ) ^ 1/ 2 )k-1  +  (k“J)(l/2)k-1  =  (k"J)(l/2)k_1. 


Remark  3  Let  y,  =  =  ...  =  y,  .  If  w1  =  (w',,w' . w',  )  ->■ 

-  1  2  k  n  nl’  n2  ’  nk 

(a, 0 , 0 ,  .  .  .  ,b)  with  a  and  b  positive,  then  P(£,k;  wM  ->•  2-1  2] 

for  l  =  1,2 , . . . ,k. 

Proof:  Without  loss  of  generality,  we  assume  that  X.  =  Z . / /w ' . 

-  J  ’  l  i  m 

for  i  =  l,2,...,k  with  fixed,  independent,  identically 
distributed,  standard  normal  variables.  Clearly,  the  random 
vector  C4TT  Zx,  4T^  Z]< ,  Wnk^  converges 

weakly  to  (/a  Z1 , 0 , 0 , . . . , 0 , /b  Zk,a,0 , . . . ,0 ,b)  and  so 
Av( { 1 , 2 , . . . ,k} )  -  max^  <  ^  <  k-1  Av( { 1 ,2 , . . . , i} )  converges 
weakly  to  b[(Zk//b)  -  (Z^//a) ]/ (a+b) .  Hence, 

P(l,k;  w^)  =  P[Av(  (1 , 2  ,  .  .  .  ,k} )  >  max^  <  ^  <  Av  ( { 1 , 2  ,  .  .  .  ,  i } )  ]  -+•  1/ 

Next  consider  P(£,k)  for  i  >_  3.  Write  P(f,k)  using  (3.23)  in 

Barlow  et  al.  (1972)  and  bound  the  general  term  by 

P[Av(B1)  <  A(B2)  <  ...  <  Av(B£)]  <  P[Av(B1)  <  Av(B2UB3U .  .  .0^_1>  < 

Av(B^)].  (This  inequality  follows  from  the  Cauchy  Mean  Value 

Property  of  averages).  Now  this  bound  can  be  written  as 

PCc^Z^  <  o2  Z2  <  o3  Z3]  =  P[(o1/o2)Z1  <  Z2  <  (o3/o2)Z3]  where 

a,  /a„  -*■  0  and  a»/o0  -*■  0.  It  follows  that  lim  P(£,k;  w')  = 

1  z  o  z  n+°°  n 

for  l  >  3. 


0 
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The  number,  L^,  of  level  sets  in  y^  has  been  suggested 

as  a  test  statistic  for  the  testing  problem  discussed  in  the 

introduction.  Theorem  1  provides  stochastic  bounds  on  the 

distribution  of  L,  . 

k 

3.  APPLICATIONS. 

Example  1  Consider  the  problem,  discussed  in  the  introduction, 
of  testing  the  homogeneity  of  a  collection  of  normal  means 
against  the  trend  i  For  c  >  °>  Theorem  1 

gives 


(10)  P[X^  >  c ] / 2  < 


PCT 


01 


>  c]  <  l  C^)2-k+1 
t-7 


PC  t-1.  -  c]* 


These  bounds,  which  may  be  quite  different,  are  tabled  in 
Table  1  for  k  =  5,8,12  and  various  values  of  c.  The  values 
of  P[TQ1  >_  c]  under  the  assumption  of  equal  weights  are  also 
included.  The  equal  weights  probabilities  seem  to  be  somewhere 
around  the  average  of  the  two  bounds  and  may  provide  a  reasonable 
approximation  provided  the  weights  are  not  one  of  the  extreme 
types  suggested  by  the  "sharpness"  analysis  of  Section  2.  For 
example,  if  k  =  5,  if  we  observe  a  value  of  near  5  and  if 

we  use  the  tail  probabilities  associated  with  equal  weights, 
then  we  would  report  a  p-value  near  .05.  The  actual  p-value 
could  be  as  large  as  .1  but  not  smaller  than  .013.  Using  the 
upper  bound,  one  can  show  that  a  test  whose  significance  level 
is  no  larger  than  .05  regardless  of  the  weights  is  obtained  by 
rejecting  for  values  of  T^^  larger  than  6.5.  In  this  example,  it 
should  be  noted  that  for  k  =  8  and  especially  k  =  12  there  is 
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considerable  difference  between  the  upper  and  lower  bounds. 

The  "sharpness"  analysis  provided  by  Remarks  2  and  3 
suggests  that  P[Tq^  cj  is  close  to  the  upper  bound  when  the 
weights  associated  with  the  extreme  populations  (close  to  k  or  1) 
are  small.  On  the  other  hand,  it  should  be  close  to  the  lower 
bound  when  the  weights  on  the  extreme  populations  are  relatively 
large.  Since  the  errors  in  the  estimators  of  for  extreme 
values  of  i  are  larger  than  those  for  middle  values  of  i  (cf. 
Cryer,  Robertson,  Wright  and  Casedy  (1972)),  one  might  actually 
sample  more  items  from  these  extreme  populations  creating  the 
latter  type  of  situation. 

If  the  population  variances  are  unknown  but  of  the  form 
2  2 

o^-o  a^  with  a^  known,  then  the  likelihood  ratio  statistic, 

2 /N 

SQ1  =  1  -  X  for  testing  homogeneity  against  trend  satisfies 
P[S01  i  P<*.*>pCB(£_1)/2>  (N„i)/2  >  c3 

k 

where  N  =  £  n.,  B  ,  is  a  beta  variable  with  parameters  a  and  b, 

i  =  l  1  ^ 

=  0,  and  the  weights  for  determining  P(£,k)  are 
w.  =  n./a.;  i  =  1,2,. . . ,k  (cf.  Barlow  et  al.  (1972)).  Now,  for 

ill 

f.  >  i,  <U1+  ...  +U£_1)/(U1+  ...  +UN_1>  has  a  B(^_1)/2’  (N-f)/2 
distribution  provided  U-^  ,U2  ,  •  •  •  »un-1  are  gamma  variables 

with  a  =  1/2  and  common  3.  Thus  p^B(£_d/2  (N-£)/2  — 
increasing  in  l  and  Theorem  1  applies.  If  c  >  0  and  HQ  is  true, 
we  obtain 


PCBl/2’  (N-2 ) /2  -  c]/2  -  Pl-S01  -  c] 

-  \=2  (f-l)2  k+1  PCB(f-l)/2,(N-f)/2  -  C]* 


(11) 
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(12) 


Example  2  Again  suppose  p^  ,p2  >  •  •  •  >Pk  are  the  means  of  k 
normal  populations.  Robertson  and  Wegman  (1978)  considered 
likelihood  ratio  tests  of  the  null  hypothesis  H^:  p^  <_  p 2  <_  .  .  .  <  p 


The  configuration  HQ:  p1  =  p2 


=  p^  is  least  favorable 


within  so  that  conservative  tests  are  obtained  using  critical 

regions  computed  under  Hn.  If  the  variances  are  known  then  the 

k  _  2 

distribution,  under  Hn ,  of  T.«  =  -2  lnX  =  Y  w.  (p.  .  -  X.) 

0’  12  l  Kki  l 

.  *  ^  I  2 

is  again  a  chi-bar-squared  distribution  (w^  =  n^/cK).  Specifically, 
under  Hg , 


P[T 


12 


>  c]  =  l  P(£,k)  P[ xl  f  >  c] 
1=1  ~ 


Theorem  1  gives  the  following  bounds 

l  (£:l)2_k+lpCXK-£  >  c]  I  P[T12  1  C]  i  (PC*L2  -  C]  +  PCxk-l  -  c])‘ 


These  bounds,  together  with  the  probabilities  computed  for  equal 
weights,  are  given  in  Table  2  for  k  =  5,  8  and  12.  Unlike  the 
last  example,  for  even  as  many  twelve  populations  the  tail 
probabilities  for  the  equal  weights  case  are  not  too  different 
from  those  of  the  upper  bound.  Thus,  oomputing  probabilities  under 
the  equal  weights  case  is  recommended  provided  the  extreme  weights 
are  not  relatively  large  or  small.  The  upper  bound  in  (12)  can 
be  used  to  determine  conservative  tests  of  H^. 

2  2 

If  the  variances  are  unknown  but  of  the  form  =  a  a^ 

2  /  N 

with  a^  known  then  the  likelihood  ratio  statistic,  S^2  =  1-  X  , 
for  testing  against  all  alternatives  has  the  following 
distribution,  under  HQ , 

p[Si2  1  c]  =  P(£,k)  p[B(k_£)/ 2,  (N_k)/2  i  c]* 
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Again  let  Un »U0 , • • • ,UM  »  be  independent  gamma  variables  with 

1  2  k-l-1  N -l 

a  =  1/2  and  common  3.  Let  X  =  £  U . ,  Y  =  Uv  .  and  Z  =  £  U.. 

i=l  1  i=k-£+l  1 

Since  B(k.£_1)/ 2i  (N-k)/2  ~  X/(X+Z)’  B(k-£)/2,  (N-k)/2  ~  (X+Y>/<X+Y+Z^ 

and  (x+y)/ (x+y+z)  >_  x/(x+z)  for  all  x,y,z  >  0,  Theorem  1  also 

applies  to  this  test. 

Robertson  and  Wegman  (1978)  also  consider  likelihood  ratio 
tests  when  the  sampled  populations  belong  to  an  exponential 
family  and  when  an  order  restriction  is  imposed  on  the  parameters 
indexing  the  populations  by  either  the  null  or  the  alternative 
hypothesis.  Chi-bar-squared  distributions  arise  as  limit 
distributions  of  the  test  statistics  and  Theorem  1  applies. 

Robertson  (1978)  considered  likelihood  ratio  statistics  for 
tests  involving  order  restrictions  on  a  collection  of  multinomial 

i 

parameters.  Again,  chi-bar-squared  distributions  arise  as  ; 

limiting  distributions  and  Theorem  1  applies. 

Example  3  Suppose  we  have  two  multinomial  populations  with 

j 

parameter  sets  p  =  (p^  ,p2  ,  .  .  .  ,p^)  and  q  =  (q^q^ , .  .  .  ,q^)  .  j 

Suppose  we  have  independent  samples  from  each  of  these  populations  j 

I 

and  we  wish  to  test  H^:  p  =  q  against  the  alternative  H-^  -  HQ  where  j 


Hl:  P1  -  ql’  P1  +  p2  -  q] 


•  ’  P  2.  +  p  i 


••+Pk_ii<i1  +  <i2+---+qk-: 


Under  HQ,  the  likelihood  ratio  statistic,  -2  In  X,  has  an 

asymptotic  distribution  with  tail  probabilities  of  the  form 
k  2 

£  P(£,k)  Ptx£  b  >  c]  where  the  P(£,k)  are  determined  by  the 

•£  =  1  K"'c 

weights  P^,P 2 » •  •  • »Pk •  Of  course,  the  p  vector  is  unknown  under 
Hq  so  that  in  order  to  apply  this  result  a  least  favorable 


configuration  is  required.  Theorem  1  provides  this  configuration. 
These  results  together  with  several  other  testing  problems  are 
considered  in  Robertson  and  Wright  (1980). 
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Table  1.  The 

lower 

bound  (LB) 

and  upper  bound  (UB) 

for  PCT01 >  c] 

and  the 

value  < 

Df  PCT01  > 

c]  for 

equal 

weights 

(EW). 

k  =  5 

k  =  8 

k  =  12 

c=3 . 6  c=  5 . 0 

c  =  8 . 3 

c  =  4 . 5 

c  =  6 . 1 

c  =  9.7 

c=  5 . 3 

c=7 . 0  c=10 . 7 

LB 

.029  .013 

.002 

.017 

.007 

.001 

.011 

.004  .001 

EW 

.102  .051 

.010 

.102 

.050 

.010 

.100 

.049  .010 

UB 

.182  .098 

.022 

.289 

.166 

.043 

.441 

.284  .094 
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Table  2.  The  lower  bound  (LB)  and  upper  bound  (UB)  for  P[T12  >  c] 
and  the  value  of  P[T12  >  c]  for  equal  weights  (EW). 


k  =  5 

k  =  8 

k  =  12 

c  =  6 . 1 

CD 

• 

II 

o 

c=11.3 

c  =  9 . 9 

c  =  11.9 

c=16.1 

0=14.8 

c  =  17.1 

c  =  22. 0 

LB 

.060 

.030 

.006 

.040 

.018 

.003 

.023 

.010 

.002 

EW 

.098 

.051 

.010 

.100 

.049 

.010 

.100 

.050 

.010 

UB 

.150 

.081 

.017 

.161 

.084 

.019 

.166 

.089 

.020 
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